The Discipline of Interactive Sonification
نویسندگان
چکیده
This paper argues for a special focus on the use of dynamic human interaction to explore datasets while they are being transformed into sound. We describe why this is a special case of both human computer interaction (HCI) techniques and sonification methods. Humans are adapted for interacting with their physical environment and making continuous use of all their senses. When this exploratory interaction is applied to a dataset (by continuously controlling its transformation into sound) new insights are gained into the data’s macro and micro-structure, which are not obvious in a visual rendering. This paper defines the sub-topic of Interactive Sonification, explains how a certain quality of interaction is required, overviews current sonification techniques, provides examples of the techniques being applied interactively, and outlines a research agenda for this topic.
منابع مشابه
An Interactive Approach for Teaching Information Sonification
Teaching sonification is interdisciplinary and multifaceted. It includes areas such as information graphing, auditory parameters for representation, psychoacoustics affected by the context and combination of parameters, auditory cognition, programming and foundational synthesis or sound production. The interactive pedagogical method presented here fuses these elements in a real-time interactive...
متن کاملLearning Musical Instrument Skills Through Interactive Sonification
Interactive visualisation methods have been used to understand realtime acoustic analysis for the purpose of learning musical skills. However, interactive sonification has not often been considered, perhaps because it is assumed the musician cannot concentrate simultaneously on two sounds – their instrument’s sound, and the sonified information. However, whilst some finesse is required in desig...
متن کاملSurface Interactions for Interactive Sonification
This paper presents novel interaction modes for Model-Based Sonification (MBS) via interactive surfaces. We first discuss possible interactions for MBS on a multi-touch surface. This is followed by a description of the Data Sonogram Sonification and the Growing Neural Gas Sonification Model and their implementation for the multi-touch interface. Modifications from the original sonification mode...
متن کاملDigiti Sonus: Advanced Interactive Fingerprint Sonification Using Visual Feature Analysis
This paper presents a framework that transforms fingerprint patterns into audio. We describe Digiti Sonus, an interactive installation performing fingerprint sonification and visualization, including novel techniques for representing userintended fingerprint expression as audio parameters. In order to enable personalized sonification and broaden timbre of sound, the installation employs sound s...
متن کاملDeveloping a dancer sonification system using the Immersive Interactive Sonification Platform (iISoP)
For decades, researchers have spurred research on sonification, the use of non-speech audio to convey information. As the level of automation increases in the workplace, monitoring the state and performance of complex systems can require more cognitive resources than provided through visual information processing channels. In recent years interactive sonification and gesture-based interaction h...
متن کامل